Noname manuscript No. 

(will be inserted by the editor) 



Claus Kiefer • Gerhard Kolland 



Gibbs' paradox and black-hole entropy 



Received: date / Accepted: date 



Abstract In statistical mechanics Gibbs' paradox is avoided if the parti- 
cles of a gas are assumed to be indistinguishable. The resulting entropy then 
agrees with the empirically tested thermodynamic entropy up to a term pro- 
portional to the logarithm of the particle number. 

We discuss here how analogous situations arise in the statistical founda- 
tion of black- hole entropy. Depending on the underlying approach to quantum 
gravity, the fundamental objects to be counted have to be assumed indistin- 
guishable or not in order to arrive at the Bekenstein-Hawking entropy. We 
also show that the logarithmic corrections to this entropy, including their 
signs, can be understood along the lines of standard statistical mechanics. 
We illustrate the general concepts within the area quantization model of 
Bekenstein and Mukhanov. 
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1 Introduction 

Black holes are fascinating objects that have not yet revealed all their secrets. 
If described by Einstein's classical theory of relativity, they are characterized 
by an event horizon which encloses a region from which nothing, not even 
light, can escape. If quantum theory on a black-hole background is considered 
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in addition, it is found that black holes emit thermal radiation [T] . Black holes 
thus play a key role in the search for a quantum theory of gravity [2]- 

Our contribution deals with the black-hole entropy and its interpretation. 
We are especially interested in logarithmic corrections to the Bekenstein- 
Hawking formula of black-hole entropy and their relation to similar terms 
in ordinary statistical mechanics. By highlighting their role in the discussion 
of Gibbs' paradox, we give an interpretation of these terms that should en- 
compass all cases discussed in the literature (see [3" and the references cited 
therein). 

Let us, however, first give a brief introduction to this subject; more details 
can be found in [4J and many other references. The concept of black-hole 
entropy first arose from formal analogies of mechanical black-hole laws with 
the laws of thermodynamics. The First Law of black-hole mechanics rea 

dM ^ -^dA + findJ + -Pdq , (1) 

where M is the black-hole mass, A the area of the event horizon, J7h its 
angular velocity, J the angular momentum, <l> the electric potential, and q 
the electric charge of the black hole (if it has a charge). The quantity k 
denotes the surface gravity of the black hole. For a Kerr black hole, k is 
explicitly given by the expression 
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(2) 



2GMr+ AGM 
where 

r+ = GM + V(GM)2 _ ^2 

denotes the location of the event horizon. In the Schwarzschild limit a — s- 0, 
one recognizes the well-known expression for the Newtonian gravitational 
acceleration. (i?s = ^GM there denotes the Schwarzschild radius.) 

Since within the classical theory, the area A of the event horizon never 
decreases, this suggests a formal analogy to the Second Law of thermody- 
namics, where the entropy, S, of a closed system never decreases. This is 
re-enforced by the analogy of ((T]) with the First Law of thermodynamics: 

dE = TdS - pdV + ^idN ; (3) 

M, in particular, corresponds to E. If we tentatively identify S with a con- 
stant times A, the temperature should be proportional to the surface gravity. 

In the classical theory, this correspondence would remain purely formal. 
Its physical significance is revealed by taking quantum theory into account: 
black holes radiate with a temperature proportional to h, the Hawking tem- 
perature ^J, 



^ Here and in most of the following expressions we set c — 1. 
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The black-hole entropy is then found from ([T]) to read 



•S'bh 



kBC^A 




(5) 



here, Ip denotes the Planck length, 




1.62 X 



10 



m 



(6) 



For a Schwarzschild black hole with mass M (to which we shall mostly restrict 
ourselves), one has 



Since the entropy of the Sun is of the order of IO^^/cb, it would experience 
an increase in 20 orders of magnitude in entropy after collapsing to a black 
hole0 Gravitational collapse thus ensues an enormous increase of entropy. 

It is a big challenge for any approach to quantum gravity to provide a mi- 
croscopic derivation of black- hole entropy. The aim is to identify fundamental 
quantum gravitational entities which can be counted in Boltzmann's sense 
to yield the entropy. Both string theory and quantum general relativity have 
provided partial answers; the fundamental entities can there be D-branes or 
spin networks The picture is, however, far from being complete. In fact, 
one suffers from an embarrassment of riches, as Steven Carlip has called it 
[5]: there are many, not obviously related, approaches which yield the same 
result ([5]). There thus seems to be a universal principle behind all of them, a 
principle that is still veiled. 

A general mechanism which could provide such a universal principle is 
connected with the notion of entanglement entropy. If one divides Minkowski 
spacetime into two different regions and considers quantum correlations across 
these regions, there is a non-vanishing entanglement entropy that is propor- 
tional to the area that divides these regions ^ . This result has been discussed 
as a support for the area law ([5]) in black- hole physics. But what could give 
the entangled quantum degrees of freedom? Previous work uses quantum 
fields on a background ,6j . A universal result could perhaps be obtained from 
the quasi- normal modes which are typical for the black hole itself [7j- These 
quasi-normal modes describe the characteristic perturbations of a black hole 
before it reaches its final unique stationary state. No entanglement entropy, 
however, has yet been calculated in this case. 





In conventional units, this reads 





^ In reality, only stars with masses bigger than about 3Mq collapse to a black 
hole. 
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An area law for the entanglement entropy is also found in analogous 
situations in statistical mechanics, for example in the case of general bosonic 
harmonic lattice systems [8]. This enforces its universal nature. 

As mentioned above, there exist various microscopic derivations of black- 
hole entropy. In many of these derivations, logarithmic corrections to ([5]) are 
found if one goes beyond the leading order of the combinations. These correc- 
tions are proportional to In Sbu , but both the sign and the exact coefficient 
vary. We shall address below these terms in more detail, but turn before to 
a discussion of analogous terms in statistical mechanics. 



2 Gibbs' paradox and logarithmic corrections 

Statistical mechanics provides a microscopic explanation of thermodynami- 
cal relations. As has already been emphasized by Josiah Willard Gibbs, one 
arrives at the Boltzmann entropy only when dividing the number of per- 
mutations by iV!, where N is the number of particles. The Boltzmann en- 
tropy coincides with the expression for the entropy found in thermodynamics, 
which is known to be empirically correct. The particles are thus counted as 
being indistinguishable, a procedure that receives its justification only from 
quantum theory. With this 'Indistinguishability Postulate' one then gets an 
entropy which is additive, at least approximately (see below). This problem 
in counting states is discussed in many places, see, for example, [S] and |ilO] . 

To illustrate this situation, we consider a system of N free particles in 
classical statistical mechanics. The partition sum of this model is given by 

Z = J d^^gd^^p exp (-^) - {CmTf"^ , (9) 



where 



2 



3Ar 



2m 
=1 



(all masses being equal), and C is a constant which is independent of the 
nature of the atoms. For the entropy one gets, using standard formulae of 
statistical mechanics, 

S = k^lii Z + k-gT 



fcs^ (iny-l- ^ln(CmT) -f ^ ) . (10) 



dT 

This expression for the entropy is not additive, that is, the entropy does 
not double if volume and particle number are doubled. It would thus be in 
conflict with thermodynamics. 

Consider now the following consequence of this formula. We have a box 
filled with an ideal gas of free particles, see Figure 1. 
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Fig. 1 A box with an ideal gas of particles is divided into two parts with equal 
volume and particle number. 



A partition divides the box into two equal parts, each of which is charac- 
terized by volume V and particle number TV. If one removes the partition at 
constant temperature, one gets from (jlOp the following increase in entropy: 

AS^2kBN\n2. (11) 

On the other hand, in phenomenological thermodynamics one would expect 
that AS = because the situation is reversible: removing and re-inserting 
the partition is a reversible process, since the state of the gas does not change. 
This discrepancy is known as Gibbs' paradox [llj . It is usually remedied by 
assuming that the particles are indistinguishable and therefore dividing the 
partition sum Z by iV!, the number of particle permutations. Instead of Q 
one then gets the expression 

^ - -w\ • ^^^^ 

In order to calculate the new entropy expression, we use Stirling's formula, 
which is valid for large particle numbers iV ^ 1, 

In/V! = iVlniV-7V + iinAr+iln(27r) + C' . (13) 

Instead of (fTO|) we then find the expression for the 'Gibbs entropy', 

^Gibbs = 5 - fee In TV! 

f V ?, , ,5 \nN ln(27r)\ , , 

(This is sometimes called the 'Sackur-Tetrode equation' [TO]-) Apart from 
the last two terms (which are very small), this expression for the entropy is 
now additive. Removing the partition in the box described above, we now 
get for the change in entropy the result 

zi^ « ifcslnTV < 2A:B^ln2 , (15) 
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which, in contrast to (jlip . is almost zero. Up to a term proportional to In A^, 
the result of statistical mechanics now coincides with the thermodynamical 
result AS = 0. 

The fact that there is not an exact coincidence can easily be understood: 
the term proportional to In N describes fluctuations. If the partition is re- 
moved, fluctuations with larger magnitude than in the presence of the par- 
tition become possible; thus, a little more states become available. In this 
sense, the removal of the partition is not quite reversible. As discussed in de- 
tail in [TT) . this situation corresponds to a 'microscopic preparation', where 
N identical particles are initially placed on each side of the partition at the 
same temperature. If, instead, one makes a 'macroscopic preparation' (with 
knowledge only about the pressure and the temperature, but with no infor- 
mation about the exact value of N) , one finds the exact result AS = upon 
removing the partition. 

It is important to emphasize in this connection the important difference 
between identity and indistinguishability [9]. In classical mechanics, different 
particles are not identical even if they are indistinguishable; in principle, they 
can be identified and have therefore to be counted separately0 In quantum 
theory, on the other hand, one does not have 'particles', but only field modes. 
If one has, for example, a wave packet with two bumps, the exchange of the 
bumps describes the same state - in this sense both states (before and after 
the exchange) are identical. It is only this identity that justifies the division 
of the partition sum by iV!. 

Quite generally, one can write the ensemble entropy related to a reduced 
density operator as a sum of the averaged physical entropy (which is a definite 
function of volume, temperature, etc.) plus the entropy of missing informa- 
tion, the latter being usually much smaller than the former [9]. Consider, 
for example, the case of a grand-canonical ensemble, for which the density 
operator reads 



where /i is the chemical potential. Only the mean particle number is specified 
here, because the system is assumed to be in contact with a particle reservoir. 
If this contact is closed, the particle number assumes a definite value, but this 
value is unknown. The corresponding relative entropy of missing information 
about this value is of order hiN/N , which just corresponds to the entropy 
increase in (fT5|) . 



^ To quote from Otto Stern's paper 12 ■. "The conception of atoms as particles 
losing their identity cannot be introduced into the classical theory without contra- 
diction. This is possible only on the ground of the non-classical ideas of quantum 
theory." 




(16) 



7 



To conclude this section, we briefly discuss a simple model which can also 
serve as an analogy for the black- hole case. Consider a set of N spin- 1/2 
particles out of which n point up and N ^ n point down: 



iitititttl 



Since N is assumed to be given, we have a microcanonical ensemble. We 
define the entropy as the logarithm of the number of configurations with n 
spins up and N — n spins down. 

In a realistic setting, n could correspond to the magnetization as the given 
macroscopic quantity. 

Consider first the 'equilibrium case' n = N/2. Using one gets from 
(fT7|) . neglecting terms of order 1/iV, 

S ^ N\n2--\nN +-\n- . (18) 

2 2 TT 

Defining 5*0 = In 2, we see that the relative contribution of the second term 
is just of order \nN/N . In contrast to the above, it comes with a minus sign; 
the reason is that it does not describe missing information because N is fixed 
from the very beginning (since we have here a microcanonical ensemble) . Note 
that we can approximately write 

5 « S'o - ^ In 5*0 . 

In the general case (jl7p we get (assuming both n and N to be large numbers) 

S = -N{w\nw + [l - w)\n{l - w)) - ^ ln(iVw(l - w)) - ^ ln(27r) , (19) 

where w = n/N . Defining now 

So = ~N{w\nw + {l~w)\n{l~w)), (20) 

we find 



S = 5„-lln5„-lln( ^'""'^-'"' ) . M 



where a — {w ~ 1) ln(l — w) — w\nw. 

Figure 2 compares the exact expression for the entropy with 5*0 and 5 
according to (fT9|) . One easily sees that (fT9|) is an excellent approximation 
unless n OT N are small numbers. 
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Fig . 2 Comparison of t he e xact entropy (|17p with the approximations with, Eq. 
(|21l) . and without, Eq. (|20p . the logarithmiccorrection term for A'' = 20. The 
difference between the exact expression and (|21|l is hardly noticeable. 



3 Logarithmic corrections to black-hole entropy 

The big challenge in understanding black-hole entropy is to provide a mi- 
croscopic interpretation for it. This is possible only in quantum gravity, a 
theory which presently does not exist in a complete form. Two major ap- 
proaches within which the interpretation of the entropy can be tackled are 
quantum general relativity and string theory [2] . For example, loop quantum 
gravity, which is a particular case of quantum general relativity, gives a dis- 
crete spectrum for an appropriately defined area operator; the area of the 
event horizon can then only assume discrete values plll3j. Before we turn 
to this case, we demonstrate the essential features in the context of a much 
simpler model: we assume the presence of an equidistant area spectrum as 
put forward by Bekenstein and Mukhanov [14j . Such a spectrum can also be 
found from quantum geomtrodynamics [15j . It is given by 



where k is an integer number > 1. The intuitive picture is that the horizon 
is divided into small cells with area (41n/c)Zp, see Figure 3. 

In each cell there are 'spins' which can assume k different values. The 
simplest case is /c = 2, so one bit of information can be put on each cell, 
cf. Wheeler's notion of 'it from bit' [16]. Inspecting the spin model dis- 
cussed at the end of the last section, one recognizes that one can identify 
the Bekenstein-Hawking entropy ([5]) with the leading term Sq = A^ln2 of 
the equilibrium entropy. This is not possible for the non-equilibrium case 
(fT9|) . which sounds reasonable, since one would expect that the spins are 
equally distributed on the surface of a big black hole. Taking into account 



An = {4:lnk)llN , 



(22) 
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Fig. 3 Symbolic attachment of bits to the surface of a black hole. 



the corrections to Sq from ITSl) . one arrives at the following expression for 
the black- hole entropy in the Bekenstein-Mukhanov model when using (P^ : 



The logarithmic correction term has a negative sign because one has here a 
microcanonical ensemble - the value of the area is fixed, and one therefore 
has a slight increase of information from the knowledge of the microstate 
compared to ([5]). The situation would be different in a grand-canonical setting 
in which the area can fluctuate and only the mean value of A is known; then 
the sign of the logarithmic term would be positive, corresponding to missing 
information. This difference has been clearly emphasized by Gour [17 . 

The analogue of the black-hole mass M is in statistical mechanics the 
energy E; the analogue of the area A is the particle number N. Situations 
in which A is fixed lead to an increase of information by going beyond the 
highest order in N, whereas situations in which A fluctuates lead to a decrease 
of information (of information about the exact value of A) . 

In this simple model we can also evaluate the exact value for the entropy 
by making use of (|17p . Inserting there N ~ Af^/4lpln2 and n = N/2, one 
gets 



S 




(23) 



S' = In 




2 



(24) 



It may be of interest to compare this exact expression with the approximate 
expression (|23p in order to see how good the approximation is. Consider, for 
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example, a small black hole with N — 20. We then have A20 « 55.45 Zp, and 
the number of states is 



which corresponds to the exact entropy S = In 184756 « 12.127. The ap- 
proximate entropy, as found from (|23p . is S ~ 12.139, which is only slightly 
larger than the exact value. (The dominant term A/Alp is about 13.86.) Thus, 
although this black hole is rather small, the approximation found by using 
Stirling's formula is still quite good. This black hole has a radius Rs ~ 2.1 Ip, 
a mass M « 1.05 mp, where mp ~ h/lp is the Planck mass and, from 
a temperature Tbh ~ 4.7 x 10^^ GeV. Once the black hole approaches the 
Planck scale, the whole approximation breaks down and one would have to 
use the full quantum theory of gravity [2]. 

As we have seen, the relative contribution of the logarithmic correction 
term is negligible even for relatively small black holes. Even a primordial 
black hole with M « 10~^^Mq (which could have been formed in the early 
universe) gives a logarithmic correction with relative contribution only of 
4.4 X 10-4°. 

In the Bekenstein-Mukhanov model, logarithmic contributions to the 
main contribution to the entropy appear naturally, see (j23p . Such terms also 
arise from various approaches to quantum gravity [3J . Let us concentrate on 
two of them: loop quantum gravity and string theory. 

In loop quantum gravity, black-hole entropy follows from counting all pos- 
sible punctures of a spin network with the horizon. A spin network is charac- 
terized by a collection of quantum numbers j and to, where j € 1, f , • . .} 
and TO = — j, . . . , j. The combinatorial problem is difficult p!8lll9j . The en- 
tropy turns out to be proportional to the area only if the exchange of nodes 
in the spin network produces a different state, that is, if the counting is 
performed without dividing by the corresponding number of permutations. 
Otherwise the entropy would come out to be proportional to the square root 
of the area instead of the area itself. This would be in conflict with the laws 
of black-hole mechanics, which correspond to the level of thermodynamics. 
If the nodes are treated as distinguishable, the proportionality to the area is 
found. The exact expression ([5]) can only be recovered if an unknown param- 
eter of loop quantum gravity (the Barbero-Immirzi parameter (3) is chosen 
appropriately. A logarithmic correction term arises if one imposes in addition 
a 'spin projection constraint' of the form rrii = 0. It turns out to be of 
the same form as in ((23|) . that is, it comes with a factor —1/2. As we have 
discussed above, the reason for the minus sign is the fact that the area of 
the horizon is assumed to be fixed in this approach and that the additional 
constraint therefore can only lead to an increase of information (decrease of 
entropy), different from the case where the area fluctuates. 

In string theory, the situation is different. There, the Bekenstein-Hawking 
entropy ([5]) is recovered by counting states of D-branes in a weak-field situa- 
tion without black holes but duality-related to a situation with black holes, 
see, for example, [10] and the references therein. Corrections are also found, 
and they start in many cases with a term proportional to hi A. The signs 
of these terms vary, which again seems to depend on whether area is fixed 
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or not. In contrast to loop quantum gravity, invariance under permutations 
is assumed, that is, the fundamental 'particles' are assumed to be indistin- 
guishable. 

As the analogy with the above examples shows, the terms proportional 
to In TV come mainly into play through the application of Stirling's formula 
beyond the highest order. They are thus not necessarily of 'quantum origin', 
but can arise already from classical statistical mechanics (as can be seen from 
the fact that they are not proportional to h) . 

In most of the above foundations of black-hole entropy, the black hole is 
considered to be in a state corresponding to a microcanonical ensemble. The 
canonical ensemble (black hole in a heat bath) is undefined in an asymp- 
totically flat spacetime because it would yield a negative specific heat and 
formal energy fluctuations with a negative variance. Therefore, logarithmic 
corrections cannot be computed in this case. The situation improves if the 
black hole is put in a box [21] or in anti-de Sitter spacetime [3] . As discussed 
in detail by Don Page, logarithmic terms can easily show up by going from a 
microcanonical to a canonical ensemble and vice versa. This shows that "en- 
tropies need to be defined carefully before there is any unambiguous meaning 
to logarithmic corrections" [3] . 

We conclude this section by presenting some numerical examples for the 
size of the logarithmic corrections. We assume that we have the relation (in 
units of fee) 

S = S'bh ^ 2 + ■■■ ■ (25) 

Let us consider, for example, the galactic black hole, which lurks in the centre 
of our Milky Way and which has a mass M w 3.6 x IO'^Mq [22]. From 
one gets 

Sbh « 2 X 10^7 I , (26) 
iv 

which is, of course, enormous compared to any laboratory-scale entropy. It 
is even bigger than the entropy of the cosmic background radiation, which is 
known to dominate the non-gravitational entropy of the observable part of 
our Universe 9J. The galactic black hole also possesses angular momentum, 
which slightly reduces its entropy (in the extremal case, one would have half 
of the value in (dS))). The logarithmic correction leads to the following tiny 
decrease in entropy: 

- ^hiSBH« -1.4 X 10-21 i , (27) 

which is about 7 x 10^*^ of 5bh- This would be a negligible number even for 
laboratory scales! 

4 Interpretation and conclusion 

We have seen that various conceptual issues that arise in the counting of 
microscopic states for the black hole are fully analogous to ordinary statisti- 
cal mechanics. We have shown, in particular, that logarithmic corrections to 
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the Bekenstein-Hawking area law occur in a natural way. These corrections 
are not a priori of quantum nature, but have their origin in combinatorial 
relations such as Stirling's formula. The sign of a logarithmic term can be 
understood as either related to missing information (if it is positive) or in- 
crease of information (if it is negative), depending on whether the horizon 
area is fixed or not. 

The traditional Gibbs paradox has been resolved by assuming that the 
microscopic particles are identical. While in the classical theory this is an 
ad hoc assumption without justification, it can be understood from quantum 
theory, which does not contain fundamental particles. This shows that one 
should get rid of classical pictures as much as possible [9l . 

In the case of black holes, the Bekenstein-Hawking area law ^ plays in 
a certain sense the role of the entropy expression in thermodynamics; micro- 
scopic derivations from quantum gravity are expected to recover it at leading 
order. It is therefore of interest to see whether a new type of Gibbs paradox 
may arise. Surprisingly, the situation seems to be opposite in loop quantum 
gravity and in string theory: whereas the former needs fundamental entities 
that are distinguishable, the latter works with indistinguishable structures 
in order to recover ([5]). In analogy with quantum theory one would have 
expected that the fundamental 'particles' are identical, so the situation in 
loop quantum gravity needs perhaps some further understanding to become 
intuitive. 

Black holes are open systems. They can thus only be understood if their 
interaction with other degrees of freedom are consistently taken into account 
[23j . In quantum theory, this is known to lead to the emergence of classical 
properties through decoherence [24] . In a similar way, the black hole, which is 
fundamentally described by quantum theory, should assume classical prop- 
erties by interacting with other fields: these could be additional quantum 
fields or the quantum perturbations (the quasi-normal modes) of the black 
hole itself. The thermal nature of Hawking radiation can, for example, be 
understood as arising from decoherence [25j . The quantum entanglement be- 
tween these other fields and the quantum gravitational states of the black 
hole could be at the heart of the black-hole entropy. The corresponding calcu- 
lation should automatically avoid Gibbs' paradox and lead to further insight 
into the interpretation of the underlying quantum theory of gravity. 

Acknowledgements C. K. thanks Thomas Mohaupt and H. -Dieter Zeh for useful 
discussions. 
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